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Abstract. We consider the problem of estimating the period of an unknown periodic func- 
tion observed in additive noise sampled at irregularly spaced time instants in a semipara- 
metric setting. To solve this problem, we propose a novel estimator based on the cumu- 
lated Lomb-Scargle periodogram. We prove that this estimator is consistent, asymptotically 
Gaussian and we provide an explicit expression of the asymptotic variance. Some Monte- 
Carlo experiments are then presented to support our claims. 



1. Introduction 



The problem of estimating the frequency of a periodic function corrupted by additive noise 
is ubiquitous and has attracted a lot of research efforts in the last three decades. Up to 
now , most of these contributi ons have been devoted to regularly sampled observations; see 
e.g. iQuinn and Hannanl (120011 ) and the references therein. In many applications however, the 
observations are sampled at irregularly spaced time instants: examples occur in d ifferent field s, 
including among others biological rhythm research from free-liv i ng an imals (|Rua (|1999l )). 
unevenly spaced gene expres sion time-series analysis (IGlvnn et al.l (12000)1. o r the analysis of 



brightness of periodic stars ( Hall et al. ( 200ol ); Thiebaut and Rogues ( 2005 )1. In the latter 



case, for example, irregular observations come from missing observations due to poor weather 
conditions (a star can be observed on most nights but not all nights), and because of the 
variability of the observation times. In the sequel, we consider the following model: 



Yj 



3i 



J 



1,2, 



n 



(1) 



where is an unknown (real-valued) T-periodic function on the real line, {X^} are the 
sampling instants and {£&} is an additive noise. Our goal is to construct a consistent, rate 
optimal and easily computable estimator of the frequency /o = 1/T based on the observations 
{(Xj, ii)}i=i n m a semiparametric setting, where s± belongs to some function space. To 
our be st knowledge, the only a t temp t to rigorously derive such semiparametric estimator is 
due to lHall. Reimann and Rice! (|2000l ). who propose to use the least-squares criterion defined 
by S n (f) = Y2k=i (Yk — s(Xk\f)) 2 where s(x\f) is a nonparametric kernel estimator of s*(x), 
adapted to a given frequency /, from the observations (Xj,Yj), j = 1, . . . ,n. For an appro- 
priate choice of s(x\f), the minimizer of S n (f) has been s hown to converge at the parametric 
rate and to achieve the optimal asymptotic variance, see lHall et all (|2000l l. 
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Here, we propose to estimate the frequency by maximizing the Cumulated Lomb-Scargle 
Periodogram (CLSP), defined as 



fe=i 



£*5 

3=1 



-2iknfXi 



(2) 



where K n denotes the number of cumulated harmonics, assumed to be slowly increasing with 
n. Considering such an estimator is ver y natural since this procedu re might be seen as an 
adaptation of the algorithm proposed by iQuinn and Thomsonl (I199ll) obtained by replacing 
the per i odogr am by the Lomb-Scargle periodogram, introduced in iLombl (|1976l ) (see also 
Scargle ( 19821 )) to account for irregular sampling time instants. Note also that such an esti- 
mator can be easily implemented and efficiently computed using ( Press et al. . 19921 . p. 581). 
We will show that the estimator based on the maximization of the cumulated Lomb-Scargle 
periodogram A„(/) is consistent, rate optimal and asymptotically Gaussian. It is known that 
frequency estimators based on the cumulated periodogram are optimal in terms of rate and 
asymptotic var ia nce in the cases of continuo u s time observations and r egular sampling (see 
Golubev! (jl98ah : buinn and Thomsonl (jl99lh : iGassiat and Levy-Ledud (j200fih ). We will see 
that, somewhat surprisingly, at least under renewal assumptions on the observation times, 
the asymptotic variance is no longer optimal in the irregular sampling case investigated here. 
However, because of its numerical simplicity, we believe that the CLSP estimator is a sensible 
estimator, which may be us ed as a starting value of more s ophisticated and computationally 
intensive techniques, see e.g. Hall. Reimann and Rice ( 200ol ). The numerical experiments that 
we have conducted clearly support these findings. 

The paper is organized as follows. In Section [21 we state our main results (consistency and 
asymptotic normality) and provides sketches of the proofs. In Section El we present some 
numerical experiments to com pare the performances of our estimator with the estimator of 
Hall. Reimann and Rice ( 200ol ). In Section HI we provide some auxiliary results and we detail 
the steps that are omitted in the proof sketches of the main results. 



2. Main results 

Define the Fourier coefficients of a locally integrable T-periodic function s by 

f-T 



(s) = - [ s(t)e- 2ikwt / T dt, fceZ so that s(t) = V c p (s)e 2i7rp '/ T , (3) 



when this expansion is well defined. Recall that the frequency /o = 1/T of s* is here the pa- 
rameter of interest. Consider the least-squares criterion based on observations {(X;, ij)}i=i 



An 



L n {f,c) = Y J \Y J - ^c t e*ft , c=[c. Kn ,...,c K J T (4) 

3=1 \ k=-K n J 

where {K n } is the number of harmonics. For a given frequency /, the coefficients c n (/) = 
[c-x n , • • • i ck„] which minimize (JI|) solve the system of equations G n (f)c n (f) = nc n (f), where 
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the (Gram) matrix G n (f) = [G nik ,i(f)]-K n <k,l<K n and the vector c n (/) = [d- Kn (/),•••, c Kn (/)] 
are defined by: 

G n Mf) = Y. e ~ 2i(k ~ l)nfX3 and c l (f) = l J2 Y ^~ 2UnfXj ■ (5) 
3=1 n i=i 

An estimator for the frequency /o can then be obtained by minimizing the residual sum of 
squares 

n 

f ~ L n (/,{c fe (/)}) = 5]^ 2 - n 2 c^(/)G,- 1 (/)c n (/) . (6) 

3=1 

Note that computing c n (/) is numerically cumbersome when is large since it requires to 
solve a system of 2K n + 1 equations for each value of the frequency / where the function 
L n (fi{ck(f)}) should be evaluated. In many cases (including the renewal case investigated 
below, see Lemmas Q] and [2]), we can prove that, as n goes to infinity, if the number of 
harmonics K n grows slowly enough (say, at a logarithmic rate), the Gram matrix G n (f) is 
approximately G n (f) ~ nld2K n +i, where Id p denotes the p x p identity matrix; this suggests 
to approximate L n (f,{c k (f)}) by / i-> YTj=i Y j ~ n Y,\k\<K n |cfc(/)| 2 - The minimization of 
this quantity is equivalent to maximizing the cumulated periodogram A n defined by ([2]). 
That is why we propose to estimate /o by f n defined as follows, 

An(/n)= SUp A n (/), (7) 

[/mill) /max] 

where [/mim /max] is a given interval included in (0, oo). Consider the following assumptions. 

(HI) is a real-valued periodic function defined on R with finite fundamental frequency /*. 

(H2) {Aj} are the observation time instants, modeled as a renewal process, that is, Xj = 
X]i=i Vk, where {Vk} is a an i.i.d sequence of non- negative random variables with finite 
mean. In addition, for all e > 0, sup| t | >e \&(t)\ < 1, where $ denotes the characteristic 
function of V\ , 

$(*) = E[exp(itVi)] . (8) 

(H3) {ej} are i.i.d. zero mean Gaussian random variables with (unknown) variance a\ > 

and are independent from the random variables {Xj}. 
(H4) The distribution of V\ has a non-zero absolutely continuous part with respect to the 

Lebesgue measure. 

Recall that in (HU) the fundamental frequency is uniquely defined for non constant functions 
as follows: T* = 1//* is the smallest T > such that s*(t+T) = s*(t) for all t. All the possible 
frequencies of s* are then /*/Z, where I is a positive integer. Note that the assumption made 
on the distribution of V\ in (H2]) is a Cramer's type condition, which is weaker than (H3]). 

The following result shows that /„ is a consistent estimator of the frequency contained 
by [/miiD /max] under very mild assumptions and give some preliminary rates of convergence. 
These rates will be improved in Theorem under more restrictive assumptions. 
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Theorem 1. Assume (L{l\)-(I{^). Let {K n } be a sequence of positive integers tending to 
infinity such that 



lim K n \R(n l3 ) + n- 1/2+l3 ) =0 for some (3 > , 



where 



m > . 



0) 
(10) 



R(rn) = ^ \c k {s+ 
\k\>m 

Let f n be defined by |?|) with < f m \ n < / max such that fo is the unique number f £ [f m in, /max] 
for which s* is 1 / / -periodic. Then, for any a > 0, 

f n = fo + o p (n~ 1+a ) . (11) 

If we assume in addition thatM(Vi) is finite, then 

n(/n-/o)-0 o.s. (12) 

Proof (sketch). Since /* is the fundamental frequency of s*, the assumption on [/ m i n , /max] is 
equivalent to saying that there exists a unique positive integer £ such that 

/min — f*/@ — /max j (13) 

and that f^jl = fo. Using ([T|), we split A n defined in (0) into three terms: A n (/) = D n (f) + 
£n(/) + Cn(/) where 

An 



1 



fe=i 



-2ifc7r/Aj 



J'=l 



A n n 



^ = ^EE cos{2irkf(Xj - X r )} Sit {Xj)e 
n k=ij,j'=i 



3' ' 



Cn(/) 



n 2 



fc=l 



E £ j 



-2UewfXj 



(14) 
(15) 

(16) 



We prove in LemmaHJof Section [3] that £ n +Cn tends uniformly to zero in probability as n tends 
to infinity. Then, by Lemmas [5] and [6] proved in Section \4. 21 for any a, D n is maximal in balls 
centered at sub-multiples of /* with radii of order n~ 1+a with probability tending to 1. Since, 
by (d2]), the interval [/mim /max] contains but the sub-multiple f+/l = fo, f n satisfies (fTT|) . 
This line of reasoning is detailed in Section 14.31 The obtained rate is then refined in (|12|) by 
adapting the consistency proof of iQuinn and Thomsonl (|199ll ) to our random design context 
(see Section Ol) . □ 

Remark 1. One can construct a sequence {K n } satisfying Condition ([9]), as soon as 

5^|cfc(**)| < +oo , (17) 



which is a very mild assumption. 

Remark 2. Observe that fo = f* in Theorem [T] if and only if f+/2 < / m in < /* < fn 
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Remark 3. If f m \ n and / max are such that s± has several frequencies in [/ m in, /max]) that 
is, (fT3j) has multiple solutions t = Z mm , . . . , l max , by partitioning [/ mm , /max] conveniently, 
we get instead of (fTT]) (resp. (|12p ) that there exists a random sequence (£ n ) with values in 
{^min, • • • , ^max} such that /„ = f+/£ n + o p (n~ 1+a ) (resp. n(f n - f*/£ n ) -> 0). This is not 
specific to our estimator. Unless an appropriate procedure is used to select the largest plausible 
frequency, any standard frequency estimators will in fact converge to a set of sub-multiples 
of/,. 

We now derive a Central Limit Theorem which holds for our estimator when Condition ([9]) 
is strengthened into (|18f) and (I19p and a finite fourth moment is assumed on V\. 

Theorem 2. Assume (L{J\)-(L^. Assume in addition that E[V^ 4 ] is finite and that s* satisfies 



^|fc| 3 |c fc (s*)| < +oo . 



(18) 



Let {K n } be a sequence of positive integers tending to infinity such that 

for all e > . 



lim K n n 

n— >+oo 



(19) 



Let f n be defined by £fy with < f ra \ Q < / max such that /q is the unique number f G [/ m in> fn 
for which s* is 1/ / -periodic. Then we have the following asymptotic linearization: 



where fi = E(Vi) and 



M /o 



Moreover f n satisfies the following Central Limit Theorem 

n 3/2 (A-/o)^AA(0,d 2 ), 
/o 



where 



a = 1. 



1 + 



S*Sj, 



l-|$(2fc7T/,)| 2 

|l-$(2A;7r/*)| 2 



(20) 



(21) 



(22) 



(23) 



where <£, defined in (Ep, denotes the characteristic function of V\ and {ck(s),k G Z} denote 
the Fourier coefficients of a 1 / f* -periodic function s as defined in with T = l/f±. 

Proof (sketch). To derive (|20p . we use a Taylor expansion of A n (/), the first derivative of 
A n (/) with respect to /, which provides 



An(/n)=An(/o) + (/n-/ )An(/;), 



6 C. LEVY-LEDUC, E. MOULINES, AND F. ROUEFF 

where f' n is random and lies between f n and /o- We prove in Sections 14.51 and 14.61 that 

k M = E - f ) & + + o P (v^), (24) 

K(fn) = -^TTT / 1//0 + ^ 
12 Jo Jo 

Since s 2 is l//*-periodic and /*//o is an integer, we have 

,,2 /-l/Zo ,.2f rl/U n 2f2j 



12 J 12 /o 7 /o 

The last three displayed equations and the assumption on A n (/ n ) thus yield 

„ n 

n 3/2 (/„ - /„) = 2 f 3/2 E (x, - ^ ) **(*;) ( e , + (1 + o p (l)) + op(l) , 

and Relations (l20|) and (122]) then follow from 



- E - J» s*(-Xi)ej = Op(l) and n" 3 / 2 E (X,- - j» a*(X>*(Xj) = o p (l) , (26) 



-3/2 ' 



5 - = E 0' " ™/2) (ej + s*(Xj)) Af(0, a 2 ) . (27) 

n 1 G-kJ* 1 * j =1 



The proof of (I26|) follows from straightforward computations and is not detailed here. We 

3/7 



conclude with the proof of ((271) . By (H3]), we have S„ = a Zf j (A n Z + f7 n ) where A n 



«" 3/2 (E"=i (J " ?) 2 %(Xjj) l '\ U n = n~ 3 / 2 E"=i (j - n/2) and Z has distribu- 

r 2N 



tion M(0,a 2 ) and is independent from the Xj-'s. Therefore, since Z and U n are indepen- 
dent, (I27p follows from the two assertions 

/I \ 1/2 

An=^-c (sl)j (l + Op(l)); (28) 
-E^Wo, • (29) 



<^/V* I ^°" 2 Efc G z l c fc(^)l 2 

Assertions (|28|) and (|29p follow straightforwardly from (|53p and (|54p in Proposition [1] respec- 
tively. □ 

Remark 4. If the {14} are exponentially distributed (the sampling scheme is a Poisson pro- 
cess), then ([23]) yields a 2 = I~ l {l + 1 1 s^s^ 1 1 1/ 1 1 •s^ Hi)} > II ' Hp denoting the usual L p norm 
on [0,1//*]. 

In Gassiat and Levy-Leduc ( 20061 ) . the local asymptotic normality (LAN) of the semipara- 
metric model ([I]) is established for regular sampling with decreasing sampling instants. Their 
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arguments can be extended to the irregular sampling scheme. More precisely, any estimator 
satisfying the asymptotic linearization 



n 



3/2 (/« -/*)=( n3 /4 f £ - i) **^' I (1 + ' (30) 

3=1 



n 



where J* is defined in (1211). is an efficient semiparametric estimator of f* in the sense of 



McNenev and Wellnerl (|2000i ). As a byproduct of the proof of Theorem [2j one has that the 
right hand-side of (|30jl is asymptotically normal with mean zero and variance Hence i^T 1 
is the optimal asymptotic variance. In view of (j20j) and (|22|) . we see that the linearization of 
our estimator / n contains an extra term since £j in (|3Up is replaced by (sj + s+(Xj)) in (|2L)p. 
This extra term leads to an additional term in the asymptotic variance (1231) . which highly 
depends on the distribution of the VJt's. Hen ce our estimator e njoys the optimal n~ 3 / 2 rate but 
is not efficient. The estimator proposed in lHall et al.1 fcoocl ) is efficient and thus, in theory 



outperforms the CLSP estimator. On the other hand, our estimator is numerically more 
tractable, and it does not require a preliminary consistent estimator. In contrast, an interval 
co ntaining th e true frequency with size at o p (n _ ( 3 / 2-1 / 12 )) is required in the assumptions 
of lHall et al.1 (hoooh (see p. 554 after conditions (a)-(e)) and, whether this assumption is 



necessary is an open question. Nevertheless, since our estimator is r a te op timal, it can be 
used as a preliminary estimator to the one of Hall. Reimann and Rice (j200ol ) . 



3. Numerical experiments 

Let us now apply the proposed estimator to periodic variable stars which are known to 
emit light whose intensity, or brightness, changes over time in a smooth and periodic manner. 
The estimation of the period is of direct scientific interest, for instance as an aid to classifying 
stars into different categories for making inferences about stellar evolution. The irregularity 
in the observation is often due to poor weather conditions and to instrumental constraints. 

We benchmark the CLSP estimator with the least-squares method (see (JE])), which is re- 
ported as g iving the b e st em pirical results in an extended simulation experiment which can 



be found in lHall et al.l (|2000l ). In this Monte-Carlo experiment, we generate synthetic obser- 
vations corresponding to model ([T]) where the underlying deterministic function s± is obtained 
by fitting a trigonometric polynomial of degree 6 to the observations of a Cepheid variable star 
avalaible from the MACHO database (http:/ /www. stat.berkeley.edu/users/rice/UBCWorkshop). 
Figure [T] displays in its left part the observations of the Cepheid as points with coordinates 
(Xj modulo 3.9861, Yj), where 3.9861 is the known period of the Cepheid and the Xj are the 
observation times given by the MACHO database. In the right part of Figure [H the observa- 
tions (Xj, s+(Xj)) are displayed as points with coordinates (Xj modulo 3.9861, s+(Xj)) where 
s* is a trigonometric polynomial of degree 6 fitted to the observations of the Cepheid variable 
star that we shall use. 

Let us now describe further the framework of our experiments. The inter-arrivals {14} 
have an exponential distribution with mean 1/5. The additive noise is i.i.d. Gaussian with 
standard deviations equal to 0.07 and 0.23 respectively (the corresponding signal to noise 
ratios (SNR) are lOdB and OdB). Typical realizations of the observations that we process are 
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0.5 1 1.5 2 2.5 3 3.5 4 



Figure 1. Left: Cepheid observations, Right: Trigonometric polynomial 
fitted to the Cepheid observations. 

shown in Figure [2] when = 0.25 and n = 300 in the two previous cases on the left and 
right side respectively. More precisely, the observations (Xj , Yj ) are displayed as stars with 
coordinates (Xj modulo 1//*, Yj) and the observations (Xj, s*(Xj)) of the underlying function 
s+ are displayed as points with coordinates: (Xj modulo 1//*, s*(Xj)). Since E(V±) = 1/5, 
n = 300 and 1//* = 4 approximately 15 periods are overlaid. 



i f %*l ** *' 
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Figure 2. Deterministic signal ('.') and noisy observations (V) with 
SNR=10dB (left) and OdB (right). 



The least-squares and cumulated periodogram criteria (L n and A n ) are maximized on a grid 
ranging from 0.2 to 0.52 with regular mesh 5 x 10 -5 . Since the fundamental frequency is equal 
to 0.25, the chosen range does not contain a sub-multiple of the fudamental frequency but a 
multiple. Hence we are in the case I = 1 in ([TBI , see Remark[3l We used K n = 1, 2, 4, 6, 8. The 
results of 100 Monte-Carlo experiments are summarized in Table [TJ We display the biases, 
the standard deviations (SD) and the optimal standard deviations forecast by the theoretical 
study when n = 300, 600 and SNR=10dB, OdB. 
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0.37 
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2.70 


2.22 
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-0.24 
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Table 1. Biases, standard deviations of the frequency estimates for different 
methods: Least-squares (LSI, LS2, LS4, LS6, LS8), Cumulated Periodogram 
(CP1, CP2, CP4, CP6, CP8) with K n = 1,2,4,6,8. 



From the results gathered in Table HJ we get that the least-squares estimator produces 
better results than the CLSP estimator. Nevertheless, the CLSP estimator can be used as an 
accurate preliminary estimator of the frequency since its computational cost is lower than the 
one of the least-squares estimator. For both estimators, the parameter K n has to be chosen 
carefully in order to achieve the best trade-off between bias and variance. Finding a way of 
choosing K n adaptively is left for future research. 

4. Detailed proofs 

In this section we provide some important intermediary results and we detail the arguments 
sketched in the proofs of Section [2j 

4.1. Technical lemmas. The following Lemma provides upper bounds for the moments of 
the empirical characteristic function of X\ , . . . , X n , 

1 - 

<Pn,x(t) = -E ei ^ • ( 31 ) 
i=i 

Lemma 1. Let (L^) hold. Then, for any non-negative integer k, there exists a positive 
constant C such that for all t E M., 

< C max E[Vj] n k ~ l {n A \t\~ l ) < C(l + E(V" 1 fe )) n k ~ l {n A \t\~ l ) , (32) 
< E{V^ k )n 2k - 1 + C(l + E(y i fe ))n 2fc ~ 1 (n A j^" 1 ) . (33) 

The proof of Lemma[T]is omitted since it comes from straightforward algebra. The following 
Lemma provides an exponential deviation inequality for <p ni x defined in (13111 . 



E 



10 



C. LEVY-LEDUC, E. MOULINES, AND F. ROUEFF 



Lemma 2. Under Assumption (hfB), we have, for all x > and t £ K 

nx 2 \l- 



V(\<Pn,x(t)-E(<p ntX (t))\ >x) <4exp 
where $ is i/te characteristic function of V defined in 



16(2 + v/2) 



(34) 



Proof. Note that rjfc=i e lfl/fc -^(t) = Y? q =i &~ 9 (t)Ilq(t) where n,(t) = IlLi e > Ilfeli e 

Thus, 



if 

kfc=l 



*14 



n. J 



where a„, g (t) = E™ =(? &~ q (t) = (1 - - $ n " g+1 (t)), the last equality being valid as 

soon as 7^ 1. Let .Fg denotes the cr-field generated by V\, . . . , V q . Note that {a niq (t)H q (t) , q > 1} 
is a martingale difference adapted to the filtration (J- q ) q >i and 

K, q (t)U q (t)\ < 4|l-d>(t)|- 1 and E^-i [K,(t)n,(*)| 2 ] < ^ ~ < Sll-^C*)!" 1 



where E >IJ denotes the conditional expectat i on giy en T q . The p r oof th en follows from Bern- 
stein inequality for martingales (see ISteiger or iFreedmanl (119751 ) ) . □ 

For completeness, we state the following result, due to Golubev ( 19881 ). 

Lemma 3. Let C be a stochastic process defined on an interval / CM, Then, for all X,R > 0, 



sup£(r) > R < e~ Ai? sup ( X /E (e 2A£ W) ) [ 1 + A 

rGi" / T£l 



'E 



el 



dr . 



4.2. Useful intermediary results. We present here some intermediary results which may 
be of independent interest. 



Lemma 4. Assume and that is bounded. Define £ n (/) an d Cn(f) by (E 

and [Tb)) where (K n ) is a sequence tending to infinity at most with a polynomial rate. Then, 
for any < / min < / max; 6 > and q = 0, 1, . . . , 



sup 

/e[/ min ,/n- 



(/)+#>(/) =o p (^ +1 



(35) 



where, for any function h, hS q > denotes the q-th derivative of h. 
Proof. By (fT5j) and (TloD. 

$>(/) = 2^J2k*L q (X,kf) T e , d 9) (/) = ^-Ylk"e T T q (X,kf)e , (36) 
fc=i fc=i 



where e = [e u . . . , e„] T , L,(X, /) = [E™=i(^i " cos(«> {2*/^ - A,-/)} 
and T q (XJ) = [i^Xt-Xtfe^W-XM]^^. Hence, 



l<j'<n 



sup 

/ £ [/mill j /max] 



Mr 



<C7n" 2 K« +1 sup 

0</<^n/max 



2L T (X 1 f)e + e T T q {X,f)e\ . (37) 
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Note that Tr[T q (X, /)] = for q > 1, Ti[T q (X, /)] = n for q = and that the spectral radius 
of the matrix T q (X,f) is at most sup J=1 n 5Z]==i l-X ~~ ^il 9 — n ^n- For any hermitian 
matrix A having all its eigenvalues less than 1/4, IE [exp(Z T AZ)] < exp(Tr(A) + 2Tr(A 2 )). 
Therefore, for any A > 0, on the event {\a* 2 nX q < 1/8}, 



E 



^(2L q (XJ) T e+e T r q (XJ)e) 



X 



< C exp {CX 2 {L q (X, f) T L q (X, f) + Tv(T 2 q (X, /))) } 

< C exp {cx 2 n 3 x 2 n q } , 

where we have used I%(X, f)L q (X,f) < Cn 3 xl q and T[\T*(X,f)] < Cn 2 xl q . Using (fl3), 
we similarly get that E [|L g (A, /) T e| 2 | X] < CI%(X,f)L q (X,f) < Cn 3 xl q and 

E[| £ T r g (X,/)e| 2 |X] <CTr[T 2 (XJ)]<Cn 2 X 2q . (38) 

Applying LemmaEl we get that, for all positive numbers A and R, on the event {Xa* 2 nX q < 
1/8}, 



sup 

0<f<K n f u 



\2L q (XJ) T e + e T T q (XJ)e\ > R 



X 



< 



Let 5 > 0. Applying this inequality with A = n~ 3 l 2 Xn q and R = n s+3 / 2 X q , we get 



sup \2L q (X, ffe + e T T q (X, f)e\ > n s+3 / 2 X q 

0<f<K n fm ax 



X 



<Cexp(-n s ) (l + K n X n ) . 



Now, using ([3 



su P/e[/ mi n,/„ 



&\f)+a q >(.f) 



(9), 



> n^ l l 2+25 K q+l 



< 



I sup \2L x {f) T e + e T T x {f)e\ >n &+3 ' 2 X q ) +pfc> 
\a<f<K n f m 

ax / 



n 



q+8 



< C exp(-n s ) (1 + K n n) + n~ 5/q 
which concludes the proof. 



□ 



Let us introduce the following notation. For some sequence (7 n ), and /* > 0, we define, 
for any positive integers n,j and I, 

B n (j, I) = [/nun, /max] D {/ ! |/ - jfjl\ < 7 n} and ^(j, /) = [/ min , / max ] \ B n (j, I) . (39) 

Lemma 5. Assume (UUl)-(H^) end that s* satisfies (fi7| ). Define D n (f) by with a 

sequence (K n ) tending to infinity. Then, for any e > 0, as n tends to infinity, 

sup Ai(/) = O p K n R(m n y + 



/en^BSOM) 



™7n 



where (m n ) is a sequence of positive integers, R is defined by &1(J\). Q. j is the intersection 
over integers j > 1, I = 1, . . . , K n and B c n (j, I) is defined by I139\1 with < / m i n < / max and 
(j n ) satisfying 

K n j n — > and n^ n — > oo . (40) 



12 
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Proof. We use the Fourier expansion ([3]) of denned with the minimal period T = 1//*. 
Expanding s+ in (fbfl) and using the definition of (p n ,x in (f3T1) and of R(m) in (fTUj) . we get 

2 

E Cp(s*K,x {2tt(pA - fc/)} + 2K n R(mf 

\p\<m 



Dn(f) < 

k=l 



k=l 



E c P (s^)E & n>x {2n(pU - kf)}] 

\p\<m 



+ ±D n , m {f) + 2K n R{m) 2 , (41) 



where we defined 

Kn 



buAf) = E 



fc=l 



(42) 



E c p( s *) (<Pn,x {MP/* ~ kf)} - E [<p n>x {2tt(p/, - kf)}]) 

\p\<m 

For all positive integers j and I < K n , and / £ A n = •, ;/ B^(j' ,/'), 2n\jf i , — lf\ > 2irl^ n . 
Thus, using (|32p with /c — in Lemma [Tl (|17p . and lim n _ >00 ?i-7n — ocs we § e t, for all / £ A n , 
and n large enough, 

£ 

fc=i 



E C p( S *) E \<Pn* {2vr(pA - fe/)}] 
|p|<m 



A„ 



(43) 



Consider now D n>m . For p > and g = l,...,Q(p) = [p 1 (f max - / m in)], define I f/ = 
[/mm + (<? — l)P)/min + Qp] H A n . Observe that u i— ► ip n: x{u) is a Lipschitz function with 
Lipschitz norm less than n~ l Y^j=i %j an d bounded by 1. It follows that / h-> D n>m (f) is a 
Lipschitz function with Lipschitz norm less than 



2 K 



2 n 



k=l 



i=i 



Thus, for any q = 1, . . . , such that I g is non-empty, and any f q £ Iq, supj e/(? D Ujm {f) < 

D n ,rn{fq) +C p 

=1 -^j + n ^n} ) which implies 

SUp D n , m (f) < SUp Dn,m{fq) + O p (pTlK*) , (44) 
/£A n q=\,...,Q(p) 

where, by convention, D n m (f q ) = if I q is empty. Since by (fl2J, inf teR |1 - $(t)| /(l A \t\) > 
0, and for n large enough, K n j n < 1, Lemma [2] shows that, for any / E A n , 27r|p/* — kf\ > 
2irk'y n , and y > 0, 

P(|^{2tt(pA - fc/)} - E[^ |X {27r(pA " *:/)}] | > 2/) < 4 e - c ^ 1Afe ^ < 4e~ c ^ k ^ . 
Using this bound with the definition of D n ,m{f) hi (|42p . we get, for all x > and / £ A n , 



SUp D n ,m(fq) >X \ <Q(p) SUp 



,q=l,...,Q(p) 



feA r , 



Kmif) >x)< 4Q(p)E E e- Cnx ^ a >^ 

k=l \p\<m 
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where (3k, ot p , k = 1,... , A n , \p\ < m are positive weights such that fik = 1 and ot p \c p \ = 

1. With P k = k~ 1 /(^2 k<Kn k" 1 ) > 2k" 1 / log(A' n ) for n large enough, and a p = (^2 p \cp\) > 
C, we get 

P ( sup D n>m (f q ) >x)< 4Q(p)K n (2m + i) e -<*«7»/]°s(*») (45) 

\q=l,...,Q(p) J 

Let 5 > 0. Defining p n = (n"^" 1 A" 2 log(A n )) and x = (Q(p n )K n m n ) 6 \og(K n )/(nj n ), 
implying Q(p n ) — > °o and Q(p n )K n m n — ► oo, we obtain 

sup D n .m n (f) = o p ({n 2 7 n ^m n }' 5 log(i ; C n ){n7 n }~ 1 
/GA n v 

For any e > 0, we set 5 > small enough such that {n 2 K 2 m n } <5 log(A' n ) = 0({K n n m n } e ). 
The previous bound, with ([30]). (|4l). ([15]) and flHD yields the result. □ 

Lemma 6. Assume (H^)-(lWi) and that s± satisfies (fi7| ). Define D n (f) by {1$ , with a 
sequence (K n ) tending to infinity. Then, as n tends to infinity, for all relatively prime integers 
j and I, 

[Kn/l] 

D n {jU/l)= Y, Ms^ + O^KnlWn-V*) . (46) 

k=l 

Moreover, for any e > 0, 



[K n /l] 

D n (f)- M**)'P n ,x{Mkjf i ,-klf)} 

k=l 



O p [K n R{m n ) + Kin- 1 + (K n n m^^^n" 1 / 2 ) , (47) 



sup sup 

(j,i)eV„ f£B n (j,i) 



where (m n ) is a sequence of positive integers, R is defined by U0\) . V n is the set of indices 
(j,l) such that j > 1 and 1 < I < K n are relatively prime integers and B n (j,l) is defined 
by ((23) with < / min < / max (7„) satisfying 

InK . (48) 

Proof. Let j and I < K n be two relatively prime integers. In the following, C denotes a 
positive constant independent of j, I and / that may change upon each appearance. As in the 
proof of Lemma El we use the Fourier expansion ((3|) of s* defined with T = 1//*. Expanding 
s* in (|14p. the leading term in D n (f) for / close to jf*/l will be given by the indices k and p 
such that k/l and p/j are equal to the same integer, say q. Thus we split D n (f) into 

[K n /l] 

Dn(f) = Y M^n,x {2tt( W -/* - qlf)}\ 2 + A n (f) , (49) 

9=1 

where 

A n(f) = Y Cp(s*)c P '(s*) l Pn,x{2n(pf i < - kf)}(p njX {^{p'f* ~ kf)} 

k,p,p' 
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with Yl'kpp' denoting the sum over indices k = 1, . . . , K n and p,p' G Z such that, for any 
integer q, we have k / ql, p ^ jq or p' ^ jq. It follows from this definition and from (fT7|) . 
since |9? n ,x| < L that 

< CY^\c P (s^n,x{Mph ~ kf)}\ , (50) 

k.p 

where Ylk p denotes the sum over indices k = 1, . . . , K n and p G Z such that, for any integer 
g, we have k ^ ql or p ^ jq. Using that j and I are relatively prime, if for any integer q, 
k ^ ql or p ^ jq, then \pl — kj\ > 1, which implies, by (|33l) with = in Lemma [2 

E [|^ n , x {2ir(p/* - kf)}\] < E [| ^ {27r(pA - A:/)}| 2 ] V2 < C (n" 1 /) 1 / 2 . 

Hence, using (I17|) and this bound in (I50|) . Relation (|49|) yields (I46D . We now proceed in 
bounding A n (f) uniformly for / G ^(j,i)ev n B n (j, I). We use the same line of reasoning as for 
bounding D n (f) in Lemma [5j First we split the sum in p appearing in (I50p and introduce 
the centering term K[ip ri! x{2Tr{pf ir — &/)}] so that 

\A n (f)\ <C \ A n , m (f) + Y^' \cp(s±)E[ip n< x{2Tr(pf* - kf)}}\ + K n R(m)\ , (51) 
\ k, P J 

where 

A»,m(/) = Y^'\ C P^)^x{MPh ~ kf)} ~ n<Pn,x{Mph ~ kf)}])\ , 
k,p 

with Yl'kp denoting the sum over indices k = 1, . . . , K n and p = 0, ±1, ... , ±m such that 
\pl ~ kj\ > 1. Using (|32|) with fc = in Lemma [T] and (|17|) . we have 

Y^\cp(s*)n^n,x{Mph-kf)}]\ <ClK n rT x . (52) 

k.p 

As for obtaining (|H|) . we cover [/ mm , /max] with Q intervals of size p — (/max — /min)/Q) 8<nd 
obtain 

sup Ai,m(/) < sup ^„, m (/ g ) + O p {pnK^) , 
feu (j ,i )eVn B n (j,i) q=h-,Q 

where either A njm (f q ) = 0, or / 9 G Ujz-^n(ji0> m which case, for all indices k and p in the 
summation term ^2'f. p , there exist integers j and Z < K n such that 

- kf q \ > \ph - kjfjl\ - ln k > U/l - ln K n > U/K n - ln K n > CK- 1 , 

for n large enough, by P5j) . Now, we apply the deviation estimate in Lemma so that, as 
in (jl5|) . we have 

P ( sup A nim (/ 9 ) >x)< 4QK n (2m + 1) e^™^ 1 . 

\q=l,...,Q I 



FREQUENCY ESTIMATION BASED ON THE CUMULATED LOMB-SCARGLE PERIODOGRAM 15 



Let 5 > 0. Setting Q = [i^ /2 n 3 / 2 ] and x = (QK n m n ) s kI /2 n" 1 / 2 so that Q -> oo and 
QK n m n — > oo as n — > oo, we finally obtain 

sup A n ^{f) = oJ(QK n m n ) 5 K 1 J 2 n^ 2 ) . 

For any e > 0, we set 5 > such that (QK n m n ) s = 0((K n nm n ) e ). Applying this bound 
in dED and using ([52]), Relation (g9|) yields g7]). □ 

The following Proposition gives some limit results for additive functionals of a renewal 
process. 

Proposition 1. Assume (L{^) and (h^. Let g be a non- constant locally integrable T '-periodic 
real-valued function defined on ~R. Assume that the Fourier coefficients of g defined by |3J) 
satisfy co(g) = and X^fcgz l c fc(#)l < 00 then for any non-negative integer k 

-i n 

^/ ff (X J ) = O p (n- 1 /2). (53 ) 



n k+l 



Denote by s n (t) the piecewise linear interpolation 

[nt] 

s n (t) = Y,9( x k) + {nt - [nt])g(X [nt]+1 ), t>0, 

k=l 

where [x] denotes the integer part of x. Then, as n — > oo, 

{ni 2 g r 1/2 s n {t) => B{t) , where 7 2 = ^ \c k (g)f )~ ^J^l (54) 

fcG z\{0} \l-H^k/T)\ 

is positive and finite, =^ denotes the weak convergence in the space of continuous [0,1] — > K. 
functions endowed with the uniform norm and B{t) is the standard Brownian motion on 
t€ [0,1]. 

Proof. Without loss of generality we set T = 1 in this proof section. Define the Markov chain 
{Yk}k>o, valued in [0, 1) and started at x G [0, 1] by Y = x and Y k+ i = Y k + Vk+i - [Y k + Vk+i], 
k > 0. Observe that, with the initial value x = 0, we have g(Y k ) = g(X k ) for all k > 1. 
Let us show that this Markov Chain is positive Harris and that its invariant probability is 
the uniform distribution on [0, 1 ]. We first prove that this chain is uniformly Doeblin, for a 
definition see ICappe et alJ(|2005l ). By (H3|) , there exists a non-negative and bounded function 
h such that < f™ h(t)dt < oo and for all Borel set A, F(V G A) > J A h(t)dt. It follows 
that, for any k > 1, F(X k G A) > J A h* k (t)dt, where h* k = h * ■ ■ ■ * h (k times) with * 
denoting the convolution. Observe that the properties of h imply that h* 2 is non-negative, 
continuous and non-identically zero. It follows that there exists < a < b and 5 > such 
that / 4G j afe ] h* 2 (t) > 5. Hence, for k large enough, there exists a non-negative integer I and 
e > such that h< 2k \t) = (h* 2 )* k {t) > e for all t & [1,1 + 1]. Hence, for all x G [0, 1) and all 
Borel set A C [0, 1], 

Px(Y 2k eA)> F x (Y 2k G A,X 2k G [1,1 + 1)) 
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which is the uniform Doeblin condition. This implies that Y is a uniformly geometrically 
ergodic Markov chain; let us compute its invariant probability distribution, denoted by ir. 
For all x e [0, 1] and I 6 Z, I ^ 0, we have E x [exp(2ivr/y n )] = exp(2ivr3;) ($(2vr/)) n -> , where 
we used (H2J) which is implied by (H3|). Hence, for all I E Z, I ^ 0, f t _ ex.p(2iirlt)ir(dt) = 0, 
which implies that ir is the uniform distribution on [0, 1]. Define 

g(x) = ]T c fc ( 5 )(l-cD(2^))" 1 e 2i ^. 
fcez\{o} 

By (H2J)) (1 — $(27r/c))~ 1 is bounded uniformly on k £ Z\{0}. Hence 7 9 is positive and finite. 
Moreover, X^fcez\{o} l c fc(#)(l ~~ < &(27r/c))~ 1 | < oo and we compute 

<S>(2irk) 

kez\{o} 

This yields that g is the solution of the Poisson equation g{x) — E x [g(Y{j\ = g(x) — g(t)dt. 
We now prove (f53l) . Note that, since ir(g) = 0, 



MYi)}= E Cfc ^ (i-^( 27rfc) ) exp ( 2i7r ^- 



{fc+1) E^) = -- (fcH 

3=1 3=1 

n n 

(fc+1) E^ " Wi-O) + n"( fc+1 ) E/ (Wi-i) " TO) • 



n 

3=1 3=1 



Since g is bounded, the variance of the first term is 0(n 1 ) as n — > oo. Integrating by parts 
yields, using that g is bounded, n"( fc+1 ) £™ =1 / (Ps(-Xj-i) - p 9( x j)) = n _(fc+1) P<?(^o) - 
n~ 1 Pg(X n ) + n~( k+1 ^ £" =1 [(j + l) fc - /] Ptfp^) = Op(n~ 1 ). To prove §M5) we compute, by 
the Parseval Theorem, 



o 



1 {g 2 (x)-(E x [g(Yi)]f} dx 



E {h( 9 )(l ~ ^Trk))- 1 ] 2 - |c fc G7)$(27rfc)(l - $(2^))^ 1 | 2 } 

fcez\{o} 



7| 



The end of the proof follows from the functional central limit theorem (jMevn and Tweedid . 



199.1 Theorem 17.4.4). □ 

4.3. Proof of (llip . Let a > arbitrary small and denote by {7 n } the sequence 

7n = n~ l+a . (55) 

Since £ is the unique integer satisfying (fTB"|) . for n large enough, we have B n (l, Z)D [/ m i n , /max] = 
for all I / where B n (l, I) is defined by (f39l) . Hence, for n large enough, P(/ n ^ P n (l, £)) < 
Pi + P2 , where 

Pi=P( sup A n (/) > An(/o/^) ] andP 2 =P[ sup A n (/) > A n (/ /£) 
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where • l is the same as in Lemma [5] and (J • ; the union over all j > 2 and / = 1, . . . , K n 
such that j and I are relatively prime. To show (fTTj) . we thus need to show that P\,P2 — ► 
as n — > oo. Note that 



Pi < P sup £>„(/) + 2 sup \Uf) + Uf)\ > D n (f /£) . (56) 

V/erV^OV) /e[/ mi n,/max] / 



By 0, applying Lemma [U we get 



sup \Uf) + Uf)\=o p (n- (3 / 2 ). 

f£ [/mini/max] 



(57) 



We now apply Lemma [5J Using @ again and choosing a small enough in (|55[) , we have 
Knln and, since nj n — > oo and K n — ► oo, Condition (j40j) holds. By ([9]) we have 



-1/2+/3 



+ P(n 



and, by (|55p . taking m n = n^ 3 and e small enough in Lemma [5j 



we obtain supj g p\. B%(j,l) D n (f) = o p {\). The last two displays show that the left-hand side 
of the inequality in ([56]) converges to zero in probability. Concerning its right-hand side 
D n (fo/£), Relation (|46|) with j = 1 and I = I in Lemma shows that, as n — > oo, 



(58) 



k>l 



Hence Pi — ► 0. As in (1561) . we have 



sup D n (f) + 2 sup \Uf) + Uf)\>D n (f /£) 

/eU'i^nO'.O /e[/ min ,/max] 



To prove that Pi — > 0, we u se the following classical inequality, see iGolubevI (|l988l ) or 
Gassiat and Levy-Leduc ( 20061 ). 



sup y2 \ckj{s*) i 2 < y2 



(59) 



fe=i 



which directly follows from the fact that /o is the maximal frequency of s*. Now, we apply 
Lemma EJ Using ([9]) , Condition (|4"8]) holds by choosing a small enough in ([55]) . By ([9]), we 
have K Tl (n _1 / 2+ ' 3 + P(n^)) -> and, by ([55]) . taking m n = n and e small enough in (|47p . we 
obtain, using ([59]) and ([551) . that P2 — ► 0, which concludes the proof. 



4.4. Proof of Eq. ([12]) . Let us first prove that, for any e > 0, 



sup 

Itl^n-Va-e 



Vn,x(t)| 2 " -PnV) 



r? 



Op(l) 



(60) 



where \x = E[Ui], P n (a;) 



X^fc=ie lfc< | 2 is the Fejer kernel and ip n ,x is defined in ([3T 



Indeed, using a standard Lipschitz argument and (t|2]) with the assumption IE [Up] < 00, 



E 



sup 

\t\<n-V 2 - 



fn,x{t)\ 2 ~ ~F n {nt) 

n 



1 n 

< 2n" 1 / 2 ~ £ - y^E[\X k - ku\] < 2y/Vai(V{ 
n ^— ' 



n 



k=l 
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which gives (|60f) . Now, by definition of f n , we have < A n (/ n ) — A n (fo/£). Beside, we have, 
using ([57]) . 

A n (fn)-K(fo/l) < D n (f n )-D n (f /£)+2 sup \Uf)+Uf)\ = D n (f n )-D n (f /£)+o p (l) 

/^[/mini/max] 

and, since the event {f n £ B n (l,£)} has probability tending to one, Lemma yields, for a 
small enough in ([55]), D n {f n ) - D n (f /£) < J2k=i \ck{s*)\ 2 [\cp n , x {2Kk{f -£f n )}\ 2 -l] + o p {l). 
Hence, since for a small enough K n j n < n" 1 / 2 ""/ 2 , the last three displayed equations and ([60]) 
finally yield that, < Ylk=i M s * )| 2 h F n{^ vHfo ~ Zfn)} ~ 1 + o p {l). We conclude the 
proof like in ( Quinn and Thomson! . 199ll . Theorem 1, P. 68) by observing that, for any c > 0, 
limsup^^supiii^ jF n {t) < 1 . 

4.5. Proof of Eq. §M§. We use that A„(/ ) = L(fo) + Cn(/o) + A»(/o) so that ([MD follows 
from 

Uh) = j o J2 ( v - f ) ^ + ' (61) 

Cn(/o) = ° P (v^) , (62) 



(63) 



which we now prove successively. Differentiating (fT5]) . we obtain £, n (fo) = n 1 Ej=i -^n(j) e j 
where 

n 

A n {j) = n~ l Y, E 2i 7 rA ; (X i -X / )e 2i7rfe ^-^'^^(X / ). 

j'=X \k\<K n 

In this proof section, we use the Fourier expansion ([3]) defined with T = l//o- Expanding 
s*{Xjt) and using the definition of (p n ,x in ([3T]) . we obtain for any j = 1, . . . ,n, ^4 n (j) = 
£| fc |<*„ e 2i ^ /o E_ pGZ cp(a*)(2iirfc) {X, <p n ,x[MP ~ k)fo] + ^u,x[Mp ~ k)fo]} . In the se- 
quel, we denote X n = n~ 1 '^2™ =1 Xj and ||^||2 = IEdy) 2 ) 1 / 2 . By Minkowski's inequal- 

ity Ufo) ~ Mr 1 E;=i - ^/2) £i = O p (n- 1 ELi {£;=i UnAMl} 1 ^ , 

where 

^n,l(j) = -/o-^OXjOCXn " ^/i/2) , 

A n , 2 (i) =- E (2i^)c fc (^)e 2i ^^(X j -X^) , 

|fc|>JCn 

A n>3 (i) = E E( 2i7rA; ) c p( s *) e2 " fcXj/o ^ vnMMp - k)f ] + WnMMP - k)M) . 

\k\<K n p^k 

Note that for all j = P njl (j)|| 2 < (£ peZ |*| \c k (s*)\) 2 K{(X^ - n/i/2) 2 } = O(n) 

and n-^E^ill^OOIIl) 172 < C^2(£ |fc| ^J&|| Cjfc (^)|) = (y/n), using ([IE]). Using 
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Minkowski's inequality, we obtain, for all j = 1, ... , re, 

\\A n , 3 (j)h < 2vr E \ k W c p( s *)\ (WXjVnMMP - k)Mh + y n ,x{Mp - k)Mh) ■ 

\k\<K n p^k 

Using that |Vn,x| — 1> Lemma Q] which gives E[|(/? ni x{2"7r(p — £;)/o}| 2 ] = 0{n~ l ) uniformly 
in p ^ k, we obtain \\Xj<p n ,x{2^(p ~ &)/o}||2 < ||^j - JfJ>h + J>™~ 1/2 = 0(jn~ 1/2 + 
j 1 / 2 ). By Lemma [TJ ||0 n) x{27r(p — A;)/o}||2 = ©(n 1 / 2 ) uniformly in p ^ k leading thus to 
n~ (E"=i Pn,3(i)|ll) 1/2 = °(^n) = °(V^) by (HHD- This concludes the proof of l|BIj> . 
We now prove (f62l) . Using (|36|) and (|38|) with g = 1, we get 

||Cn(/o)|| 2 < 2vrn- 2 ^A ; || e T r g (X,/) e || 2 = O (if 2 ) = o(y/n) 
k=i 

by (HS|). Hence (|B2|> . 

Let us now prove ([63]) . Using (O, we get 

^n,x[2vr(p - k)f ] (p n> x[2ir(q - fe)/o] 

+^x[2tt( P - k)f ] ^n,x[27T(g-fc)/ ]} . (64) 

Lemma [T] gives that there exists a constant C > 0, such that, for all p ^ k and q ^ k, 
E(|^ niX [27r(p - k)f ] <p n ,x[MQ-k)fo]\) < ||0»,Jf[27r(p-fc)/o]|| 2 ||¥» nj x[27r(«-A;)/o]|| 2 < C. 
Using (fl"9j) and ^ P l c p( s *)l < 00 > we S e ^ that the term Ylk^p^k q^k ™ the right-hand side 
of (f64l) is o p (y / n). Now, if p = q = k, the term in the curly brackets is equal to zero. Hence (j64"|) 
can be rewritten as D n (fo) = Sfc=i ^n,fc + o p (y/n) where 

D n ,k = E Cfc ( s ' t ) c 9( s *)( _27rfc ) |^n,x(0) 99 n ,x[2vr(g - fc)/ ] + Lp n ,x[^{q - fc)/o]} 

+ ^c p (,s*)c fc (s*)(-27r£;) {<£> n ,x[27r(p - fe)/ ] + (/? ni x[27r(p - fe)/o]^n,x(0)} • 

We will check that ^fe>x ^n,fe = o p (^/re). Using the Fourier expansion of and s*, we 
obtain after some algebra, D n (fo) = ( n /o) _1 X)j=i (-^J ~~ -^n) ^*P0) s *P0) + o p (y/n). This 
yields ([63]) by Slutsky's Lemma. Indeed, /i/2 — Yl?=i^l/ n = o p (l) and, by Proposition [H 
n~ 1/2 £i=i(M*)(*i) = O p (l), thus we have ( M /2 - n~ 2 £™ =1 *l) E?=i s*(^KP0) = 
o P (y/n). To conclude the proof of (j24l) . we have to prove that ^2k>K n D n ,k = o p (y/n). By 
Minknow ski inequality, ||E fc>if n Ai,fc|| 2 < 2vr £ fc> x n £<^fe l fe lk( s *)ll c <z(>*)l 
(||^n,x(0)(^n,x[2vr(g - fc)/o]||2+||¥'n,x[27r(Q-A;)/o]||2)- Using that \<p n> x \ < 1 and \\ip n! x[2n (q- 
fc)/o]l|2 = 0(n -1 / 2 ) by Lemma Q] uniformly in g ^ k, we get ||0 ni x(O)9J n ,x[2vr(g - fc)/o]||2 < 
\\X n - (re + l)u/2|| 2 + (re + l)u/2||^ n! x[27r(g- A;)/ ]||2 = 0{jn). By (JE} and Lemma E we 
obtain ||Efe>i<r„ A»,fc|| 2 = ■ 
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4.6. Proof of Eq. ([25]) . Using that A n = D n + £ n + ( n , applying Lemma 0] with q = 2 and 
using ([T2]) . the Relation ([25]) is a consequence of the two following estimates, proved below, 



D n (f ) = -n 2 /i 2 (12 /o)" 1 / sl(t)dt (1 + o p (l)) 

JO 

sup |A»(/o) ~ D n (f)\ = o p (n 2 ) , 

f-\f-fo\<Pn/n 



(65) 
(66) 



for any decreasing sequence (p n ) tending to zero. In this proof section, we use the Fourier 
expansion ((3]) defined with T = 1/fo . We now prove ([65]) . Using ([T4"]l , we obtain 



Kn 



b n {f) =^ 2 ^2Y1 c p (s*)c q (s*)k 2 [<£ re , x [27r(p/ - kf)] M [27r(g/ - kf)) 

k=lp,q£Z 

+2<p n , x [2vr(p/ - kf)]cp ntX [2w(qf -kf)} + cp n>X [2n(pf - kf)]<p n>x [2ir(qf - kf)]} . (67) 
For / = f , we get 



^n(/o)= (^ 2 ^|c fc ( S ,)| 2 £^ < 



•^E x ; + Jf IE** 

i=i \i=i 



+ G n , (68) 



where G n = ^ ^ c p (s + )c (? (s*)/c 2 |(/3 n: x[2vr(p - /c)/o]^n,x[2vr(g - k)f ] 

U fc=l (p,ff)?4(fc,fc) 

+2v9 n> x[2vr(p - A;)/ ]^n,x[27r(q - fc)/ ] + </>n,x[27r(p - A;)/o]^n,x[27r(<? - fe)/o]} • 

As n tends to infinity, the term between parentheses in (]68p tends to l/(2/o) Jo s 2 (i) and 
the term between curly brackets converges to — 2 / u 2 /3 + ^ 2 /2 in probability, and hence their 
product converges to the constant appearing in the right-hand side of (|65f) . We conclude the 
proof of ([63]) by showing that G n = o p (l). We split the summation ^2 pq in the definition 

of G n into three terms Y. P +k, q +k + >Zp=k,q^k + E P ^k, q =k £i=z G n,i- Observe that, setting 
C = 27rZ p \c P (s*)\, 

n\G n ,i\] < C 2 Kln~ 2 inf {E[\(p n>x (t)y n>x {t)\) + E[\^ x (t)\ 2 }} . 

|t|>27r/ 

Using that E[\^ x (t)ip n , x (t)\} 2 < E[\^ x {t)\ 2 ]E[\ip n:X (t)\ 2 ], Lemma □ yields G n>1 = o p (l). 
Note that 



8vr 



2 



E[|G n , 2 + G n , 3 |] <^^k 2 \c k (s,)\^\c q \[E[\^ x mY 2 ^[^nMMQ-k)fo]\ 



|2lV2 



fc=l 



+2E [|^ re , x (o)| 2 ] 1/2 E [tenMMq - k)M\ 2 ] 1/2 + e [\<p n ,x[Mi - *0/o]| 2 ] 1/2 } = 0(n~ 1 /2 )) 



by using that E 



n- 2 IZU X > 



Q(n 2 ), E 



0(n 4 ) and Lemma [T] 
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We now prove (i66j) . In the expression of D n (f) given by the right-hand side of (|67|) . we 
separate the summation *£ p q into three terms £ p=M + Y. P ^k, q =k + Y^ik^ik denoted by 



D n (f) = D n>1 (f) + D n>2 {f) + D n>3 (f) . 



(69) 



Using that l c fc( s *)l and E P \ c p( s *)\ are finite, and that <p\xVn,x+<Pn > x<f>n,X+<Pn,X<Pn,x 



is Lipschitz with Lipschitz constant at most n 1 Yij=i 
one easily gets that 



-n 



T.UX^UX- =O v {n% 



sup 

f-\f-fo\<Pn/n 



sup 

f-\f-fo\<p„/n 



Dn,i(f) + DnM) ~ A»,i(/o) ~ A», 2 (/o) = O p {p n n 2 ) = o p (n 2 ) . 
Let (fi)i<i<L n be a regular grid with mesh 5 n covering [/ - p n /n, fo + Pn/n]. Then, 
DnM) ~ A»,3(/0 

A»,3(/i) " A>, 3 (/o 



(70) 



< sup 

i=l L„ 



+ sup sup 

i=l,-,in/£[/l,/l+l] 



AU/) - r>„ l3 (/i) • (7i) 



Using the same argument as above with Y p \ c p( s *)\ < 00 an d Sfc=i ^ 3 = O(-KT^), we get 
that sup z=1 ___ )in sup /g[/;i/;+i] D n>3 (f) ~ D n>3 (fi) = O p (K^5 n n 3 ) . Since if n = o(ra _1 ), there 
exists A~ such that, for any n > N, any / such that \f — /o| < 1/n and any p £ Z and 
fc = 1, . . . , -fC n such that p ^ k, we have |p/o — > /o/2. Then proceeding as for bounding 
G n above, we have, for any n > N and any / such that \ f—fo\ < 1 / n , E< D n ^(f) < C K 3 n , 

where C is some positive constant. From this, we obtain sup i=1 L D n ^(fi) — D n ^(fo 



O p (L n K^n) , so that, for 5 n 



n 



-3/2 



implying L n = [p n /(n5 n )} = o(n 1/2 ), flTJ]) finally yields 



SU P/:|/-/o|<Pn/n 



DnM) ~ D nMo) = O p (i^n 3 / 2 ) , which, with (70} and (M}, gives ©. 
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